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Abstract. The 3D documentation of the tunnel surface during con¬ 
struction requires fast and robust measurement systems. In the solution 
proposed in this paper, during tunnel advance a single camera is taking 
pictures of the tunnel surface from several positions. The recorded images 
are automatically processed to gain a 3D tunnel surface model. Image ac¬ 
quisition is realized by the tunneling/advance/driving personnel close to 
the tunnel face (= the front end of the advance). Based on the following 
fully automatic analysis/evaluation, a decision on the quality of the out¬ 
break can be made within a few minutes. This paper describes the image 
recording system and conditions as well as the stereo-photogrammetry 
based workflow for the continuously merged dense 3D reconstruction of 
the entire advance region. Geo-reference is realized by means of signalized 
targets that are automatically detected in the images. We report on the 
results of recent testing under real construction conditions, and conclude 
with prospects for further development in terms of on-site performance. 


1 Introduction 

Since almost two decades, 3D scanning has been a method to survey tunnel 
surfaces, providing sufficient data to be able to reconstruct a tunnel’s true ge¬ 
ometry with a geometrical resolution of up to 1 point/cm^. The main products 
to be provided to the various parties involved in tunnel construction are a 3D re¬ 
construction of tunnel vault and tunnel face for geometrical assessment (profile 
checks) and also true color documentation of geological situation/conditions at 
the time of excavation. Various scanner technologies have been developed and 
improved since, such as the classic Dibit photo scanner m or laser scanners 
with up to spherical fields-of-view. 

During tunnel advance, time is limited and the environment is hazardous. To 
be able to quickly assess the success of a tunnel blasting round, the industrial 
environment demands for efficient, robust and accurate 3D measurements of 
the gained rock surface. The authors have laid the foundation for an automated 
end-to-end (from image to 3D Model) 3D tunnel reconstruction system, that 
is purely based on a single camera. Acquiring two profiles of images from two 
different positions gains a set of overlapping stereo couples (Section]^. The goal 
is a dense 3D reconstruction by stereo photogrammetry / structure from motion 
algorithms making use of these images (Sectiorj^. To align the reconstructed 
data set, for each measurement 4-6 signalized targets with known 3D coordinates 
(measured by an automatically searching total station) are placed on the surface 
at strategically meaningful positions, those are to be detected automatically by 
the alignment process. 
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2 Image Recording Under Production Conditions 

Due to the nature of excavation, the working area is highly hazardous to spon¬ 
taneous rockfall or spalls and other dangers caused by destruction of the rock’s 
natural stability. To regain this stability, various means of support have to be 
set in place by tunnelling construction personnel (miners) such as spikes, wire 
mesh, lattice girders and as last covering measure, shotcrete to fully cover the 
rocks natural surface. As these supporting measures are to be built-in as soon 
as possible after excavation and mock-out, the complete scanning process must 
be performed within only a couple of minutes, including setup, data acquisi¬ 
tion and geodetic measurements for geo-reference. The applied shotcrete fully 
covers the rock surface: Later re-scanning is impossible. To cope with these 
limiting conditions, capable scanning systems must fulfill a set of competing 
requirements such as easy-to-use, light, mobile, easy to maintain, and eheap. 

Various challenges to data acquisition itself and to later data processing must 
be overcome to get not only usable but best possible results from the complete 
process. Recording of scan data, either directly in 3D or as images, in a tunnel 
environment under production conditions is determined by various constraints 
such as the dependency from resources (light, power supply), geo-referencing 
(position and orientation determination) of scan data, communication for data 
transfer, environmental influences (dust, damp, dripping water, dirt), rugged¬ 
ness of hardware, mobility (one person can easily carry the equipment), per¬ 
sonnel (operators), ease of handling (simple, structured), or field-of-view (the 
number of image sequences should be minimized). 

For simplified handling, development targeted towards a single-camera based 
imaging device equipped with a motorized tilt mechanism to acquire a 360° 
(vertical) panorama. In its typical scenario the system is placed on a tripod 
close to the tunnel face in two slightly distinct positions (Fig. by one on-site 
staff person (Fig. [^. This way, stereoscopic panoramas are available. Fig. 
depicts an example of such two panoramas, forming stereo partners usable for 
further 3D reconstruction. Processing complexity constraints require the user to 
obey some simple rules for the recording process: For positioning and alignment 
the scanning system is equipped with a laser-pointer aid. In addition, the system 
should be set up roughly horizontal, with no need for further exact leveling. The 
light source should be positioned approximately one tunnel diameter behind the 
tunnel face and should not change during image acquisition. Two targets need to 
be positioned at each side of the tunnel. Reference measurements of the control 
point targets are performed remotely by an automatic total station. The total 
station is controlled by a rugged field computer which is also used for quick 
data processing and the geometry assessment (profile checks) and excavation 
optimization by the construction personnel within the tunnel. 

3 Prom Unoriented Images to 3D Tunnel Model 

From the construction companies’ point of view, the excavated areas shall not 
only be documented, but also in-situ assessed. The scanning data must be pro¬ 
cessed typically within three to five minutes to an easy to understand overview 
about the tunnel’s true geometry for immediate optimization of construction 
works. As construction personnel is neither acquainted with surveying tasks 
nor data processing, this complex task requires a fully automatie and reliable 
workflow for data proeessing, covering remote target registration by automated 
total stations, target recognition and 3D reconstruction during the processing 
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Figure 1: Left: Data acquisition system based on a consumer camera with fixed 
focus lens, and a stepper motor unit. Right: Typical data acquisition situation 
close to the hazardous region of the tunnel face. 



Figure 2: Image footprints in 3D space (top left: Image acquisition geometry). 

workflow and last, presentation of the results in an easy to understand depiction 
of the assessed tunnel section. After data acquisition and quick processing in 
the tunnel, further data processing, merging with existing or preceding scanning 
data and quantity survey is usually carried out in the field office by surveying 
or construction engineers. Geological or geotechnical interpretation of the ex¬ 
cavated rock is further made by the experts in the respective fields. 

In such a scenario, compared to controlled industrial (production-like) condi¬ 
tions, some challenges are posed to the processing framework, such as unordered 
image sequences, fairly unpredictable stereo base-length, inhomogenous scene il¬ 
lumination, partial under- or overexposure, re-positioning of light source during 
image acquisition, or unexpected objects (persons or equipment obstructing the 
tunnel surface) appearing in the images or casting shadows. In the following the 
main steps (Fig. as combined into a Python-based test suite are described. 

Image Preprocessing consists of radial and tangential distortion correc¬ 
tion and vignetting correction. In order to speed up processing image size is 
optionally reduced for fast on-site reconstruction. 

Tie-points (corresponding points in adjacent images) are identified using 
a derivate of Speeded Up Robust Features (SURF) [2] (Fig. left). Adaptive 
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Figure 3: Left: Two stereo-overlapping profiles of images of the tunnel surface. 


histogram equalization and image tiling allows to maximize coverage of tie- 
points, to ensure proper distribution, and to be insensitive to different texture 
classes (e.g. raw rock and shotcrete). For finding correspondences feature vec¬ 
tor matching is used which compares Euclidian distance, incorporating best to 
second-best match ratio, nearest neighbour approximation based on FLANN [5], 
geometric constraints, and outlier detection. 

Local Bundle Block Adjustment uses the complete tie point set to gen¬ 
erate a locally consistent set of orientations for all images involved. Since camera 
pose itself is not directly measured and transformation in reference project coor¬ 
dinate system is done by inspecting targets within the tunnel region-of-interest, 
modelling is split into two adjustment steps. Local adjustment results in a cam¬ 
era pose estimation which is consistent but imprecise and has wrong scaling. 
This already allows calculating local 3D target coordinates. Global 3D target 
coordinates are externally provided (by standard theodolite tunnel geodesy in¬ 
frastructure), therefore target assignment has to be resolved later. 

The used local and global bundler is based on the well-known (linearized) 
co-linearity equations [3]. The adjustment is described by a generalized Gauss 
Markov model [3] but we use the fact that the design matrix holding the deriva¬ 
tives with respect to the measurements is quadratic and non-singular leading the 
adjustment scheme easily to be converted to an ordinary least squares scheme. 
To increase the number of unknown parameters, we first reduce the normal equa¬ 
tions by eliminating the a priori not interesting 3D coordinates of the tie-points. 
This again can be done as the part of design matrix holding the derivatives with 
respect to the 3D coordinates of the tie-points has block diagonal structure and 
each sub-block is quadratic and non-singular. After solving the reduced adjust¬ 
ment problem this reduction of the normal equations is inverted and also the 
updated 3D coordinates of the tie-points are derived. 

For the local adjustment the first camera position is set to zero and the 
second exactly one distance unit apart. The rotation angles are initialized by 
assuming a regular sampling along the tunnel surface starting from and ending 
in a horizontal position. The major challenge of low to no stereo base between 
images of one rotation cycle could be resolved by inserting additional constraints 
and checks in the bundle adjustment procedure. We therefore excluded tie- 
points which were localized only in two or more images of the same tripod 
position and/or which were localized in less than a specified number of images. 
In the local adjustment the camera positions were kept fixed yielding only a 
relative oriented model. The adjustment is an iterative procedure, as the 3D 
coordinates have to be updated using the current orientation parameters. We 
additionally use the stochastic model to avoid an incremental rotation of the 
relative oriented model around the stereo base. 

Signalized Targets Detection and Localization is done by local thresh¬ 
olding, Hough transform, and morphology operations. Additional constraints 
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Figure 4: Workflow overview 


such as target diameter, distance to camera, circularity tolerance, and posi¬ 
tion help to minimize false positives. Geometric and epipolar constraints allow 
identifying and assigning the targets to their 3D coordinates even in regular 
industrial conditions (Fig. middle). 

Global Orientation simultaneously for all images is obtained by a seven- 
parameter transformation between the known 3D signalized points from total 
station and their local 3D coordinates as from the local bundle adjustment re¬ 
sults and 2D image positions. RANSAC is applied to detect the correct combi¬ 
nation. The fixed camera positions from local adjustment are further optimized. 
Compared to local adjustment the complexity is relaxed as the exterior orien¬ 
tations’ estimates are now already very well predicted. For low to no stereo 
base between images of one rotation cycle we use the same tie-point elimination 
strategy as in the local adjustment with a different weighting strategy. 

Dense Stereo Matching [6] is based on predictions provided from the tie- 
points matching and exploits RGB color as individual cue. 

3D Reconstruction and Tunnel Surface Modeling uses disparities for 
Locus reconstruction [Tj to project the resulting 3D and textural information on 
a surface grid on the sphere, resulting in individual patches of radial distances 
and texture (Fig. top right). 3D patches are merged in the same spherical 
coordinate system grid by unsharp masking. The result is a consistent 3D 
reconstruction of the acquired profile with a typical length of 4m (Fig. [^. 
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Figure 5: Examples for intermediate results of the Handheld workflow Top left: 
Tie points used for bundle adjustment. Top middle: Detected and localized 
signalized points. Top Right: Single-stereo 3D reconstruction projected on a 
spherical coordinate space. Bottom: Entire profile visualized in 3D. 

4 Experience and Results 

To obtain a stable, reliable system, intensive testing was conducted (unit testing, 
integration testing, interface testing, and acceptance testing). Using a 24mm 
wide-angle lens with 82° field-of-view, 6 images are acquired to cover the whole 
tunnel profile with adequate image overlaps. Eull resolution is 20 MPixels per 
image. The application is focussed on fast processing providing results promptly 
after measuring with reduced image size of 1 MPixels and evaluation time of 
few minutes on standard hardware. Dependent on the overlap area the typical 
number of tie-points is 30-100 per image. Extensive field-tests showed that it is 
possible to reduce signalized targets to 4, always 2 on opposite tunnel side. We 
optimized point detection and matching parameter sets for different textures 
(e.g. rock, shotcrete) and construction stages (raw excavation, tunnel face, top 
heading, bench). 34 representative data sets were provided by Dibit Messtechnik 
(see Eig. top for a subset) including also problematic and low-quality data, 
e.g. including occlusions due to moving objects, changing illumination, shadows, 
dirty lens, and critical deviation from requirements. At the end of the test cycle 
the software was able to successfully handle all the data sets (Eig. bottom) 
and to explore the possible limits of the Handheld system. Comparisons with 
geo-referenced laser scans of the same region show deviations less than 10mm 
(Fig-S which is well within the requirements during tunnel advance. 








Figure 6: Top: Examples of test data sets with different camera setups and 
positions, different texture and illumination, and delicate environmental con¬ 
ditions. Bottom: Examples of automatically reconstructed 3D surface models 
(spherical projection) of different data sets. 


5 Conclusions and Outlook 

The system is currently under extensive testing in real conditions on several 
construction sites within Europe. It is designed to be operated by regular staff 
as available during tunnel advance, and will not need expertise in computer 
vision, photogrammetry, or surveying. Costs are only those for a regular con¬ 
sumer camera with appropriate lens, and the simple motorized tilt mechanism. 
Once introduced in the regular construction process, it will significantly reduce 
the costs of tunnel advance documentation and at the same time raise the rich¬ 
ness of the gained data: Compared to state-of-art laser scanning hardware cost 
reductions of several tens are reached with similar performance, accuracy and 
data quality. Data acquisition time (effecting the advance process) is mini¬ 
mized to a few minutes. Safety for the operating staff is ensured by placing the 
measurement system out of the hazardous region in the immediate vicinity of 
the tunnel face. Less staff presence, lower hardware costs, lower interruption 
periods during actual construction works, higher safety for operating staff and 
the immediate availability of a full 3D description of the recorded site (in all 
desired stages) make the Handheld system a new high-value component of the 
New Austrian Tunneling method. 

Development is still ongoing. Several re-design steps in many parts of the 
workflow and Hardware set-up have been realized within the last 2 years to make 
it applicable for practical applications, operated by non-expert staff. Current 
work includes the integration of fisheye lenses to reduce the number of images to 
be recorded and to take viewpoints further away from the hazardous area close to 
the unsecured tunnel advance. A CUDA implementation for SGM (Semi-Global- 
Matching) will be introduced soon. Reducing the number of targets necessary 
for georeference, alternative orientation strategies as well as immediate feedback 
on image acquisition success in terms of data usability and scene coverage are 
further foreseen improvements. 
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Figure 7: Comparison of Handheld result with georeferenced laser scan of the 
same area. Left: Color-coded deviation on unwrapped tunnel model. Right: 
Profile of laser-based and Handheld reconstructions superimposed 
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